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Abstract 

In  this  paper  we  study  the  difficulty  of  solving  problems  in  economics.  For 
this  purpose,  we  adopt  the  notion  of  undecidability  from  recursion  theory.  We 
show  that  certain  problems  in  economics  are  undecidable,  i.e.,  cannot  be  solved 
by  a  Turing  Machine,  a  device  that  is  at  least  as  powerful  as  any  computational 
device  that  can  be  constructed  (2j.  In  particular,  we  prove  that  even  in  finite  closed 
economies  subject  to  a  variable  initial  condition,  in  which  a  social  planner  knows 
the  behavior  of  every  agent  in  the  economy,  certain  important  social  planning 
problems  are  undecidable.  Thus,  it  may  be  impossible  to  make  effective  policy 
decisions. 

Philosophically,  this  result  formally  brings  into  question  the  Rational  Expec¬ 
tations  Hypothesis  which  assumes  that  each  agent  is  able  to  determine  what  it 
should  do  if  it  wishes  to  maximize  its  utility.  We  show  that  even  when  an  optimal 
rational  forecast  exists  for  each  agent  (based  on  the  information  currently  available 
to  it),  agents  may  lack  the  ability  to  make  these  forecasts.  For  example,  Lucas  [7] 
describes  economic  models  as  “mechanical,  artificial  world(s),  populated  by  ....  in¬ 
teracting  robots”.  Since  any  mechanical  robot  can  be  at  most  as  computationally 
powerful  as  a  Turing  Machine,  such  economies  are  vulnerable  to  the  phenomenon 
of  undecidability. 


•Research  supported  by  NSF  grant  CCR-9102231,  DARPA/NASA  Ames  grant  NAG-2-593,  grants 
from  the  IBM  Endicott  Programming  Laboratory  and  Siemens  Corp. 

iDepartment  of  Economics,  Uris  Hall,  Cornell  University,  Ithaca,  NY  14853.  This  author  is  also 
supported  by  a  Cornell  Sage  fellowship. 

^Department  of  Computer  Science.  Upson  Hall,  Cornell  University,  Ithaca,  NY  14853.  This  author 
is  also  supported  by  a"  IBM  graduate  fellowship. 
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1  Introduction 

In  this  paper  we  prove  that  there  are  fragments  of  macroeconomics  about  which  it  is 
not  possible  to  reason.  In  order  to  do  so,  we  adopt  techniques  from  recursion  theory 
that  are  new  to  ihe  study  of  macroeconomics.  There  are  two  implications  of  this  result. 
First,  agents  in  such  economies  cannot  reason  about  potentially  important  facts.  Sec¬ 
ond,  economists  studying  these  economies  cannot  reason  about  them  either.  This  result 
prompts  us  to  question  the  applicability  of  various  traditional  assumptions  about  knowl¬ 
edge  in  economics.  These  include  but  are  not  restricted  to  the  Rational  Expectations 
Hypothesis  and  a  variety  of  systems  involving  the  formation  of  subjective  or  objective 
probability  priors.  We  emphasize  that  this  result  applies  to  closed  finite  economics.  By 
extension,  we  also  provide  an  insight  into  w-hat  “...a  forma)  theory  of  rational  decision¬ 
making  in  an  open}  universe..." [1]  might  confront. 

This  result  does  not  apply  to  the  kinds  of  models  macroecononiists  are  used  to  seeing 
in  journals.  Those  models  have  been  designed  to  provide  neat  answers  to  a  variety 
of  questions.  An  important  feature  that  is  almost  invariably  lacking  in  such  models, 
however,  is  a  sense  of  separation  of  numerous  heterogeneous  agents  or  sectors.  The  result 
of  this  paper  might  explain  why  economic  models  which  mimic  economies  as  distributed 
systems  of  interacting  agents  or  sectors  are  not  very  popular  today:  it  is  difficult  and 
sometimes  impossible  to  reason  about  such  economies. 

Discrete  decision  processes  are  central  to  economic  research.  Examples  of  these 
processes  are  the  Overlapping  Generations  Model  jlO,  15]  and  the  Townsend  Turnpike 
Model  [10,  13].  It  is  natural  to  ask  whether  a  systematic  method  solves  such  optimization 
problems  for  economies  with  heterogeneous  agents.  This  question  is  extremely  difficult 
to  analyze.  So  we  address  the  simpler  question:  given  an  arbitrary  economy  for  which 
there  is  a  solution  to  a  decision  making  problem,  is  it  possible  to  find  that  solution?  In 
this  paper,  we  show  by  example  that  this  may  not  be  possible  even  for  a  finite  economy. 
Thus  the  problem  is  “hard”  because  of  its  inherent  complexity,  and  not  because  the 
economy  itself  is  intractably  large.  We  present  a  problem  that  is  specified  in  all  respects 
except  for  its  initial  condition  and  show  that  it  is  “hard”  to  solve. 

To  prove  such  a  result  we  use  the  concept  of  a  Turing  Machine.  A  Turing  Machine 
is  a  computing  device  w’hich  is  capable  of  executing  any  possible  computing  algorithm 
including  every  possible  learning  algorithm  and  fine  tuning  mechanism.  There  is  strong 
evidence  that  a  Turing  Machine  is  at  least  as  powerful  as  any  computational  device 
that  can  be  constructed  [2].  A  problem  that  cannot  be  solved  by  a  Turing  Machine 
is  said  to  be  undecidable.  We  use  techniques  introduced  by  Reif  et  al  [9]  to  develop  a 
methodology  for  showing  that  a  variety  of  problems  in  economics  are  undecidable.  We 
apply  this  methodology  to  a  simple  problem  for  which  a  solution  exists,  and  show  that 
the  solution  cannot  be  found  using  a  Turing  Machine.  We  thus  demonstrate  the  degree 
of  difficulty  that  economists  would  encounter  in  characterizing  a  network  economy  in 
terms  of  discrete  interacting  agents^  with  limited  choices. 

^The  italics  are  ours. 

^These  could  be  consumers,  sectors,  producers,  trading  partners  etc. 


Figure  1:  We  prove  the  existence  of  inaccessible  facts. 


This  paper  is  divided  into  two  parts.  In  the  first  part  we  present  a  discussion  of 
knowledge  in  economics  and  an  example  of  an  economy  in  which  there  are  undecidable 
problems.  The  second  part  consists  of  four  appendices,  the  last  two  of  which  intro¬ 
duce  optimization  and  recursion  theory  to  readers  without  any  background  in  these 
subjects.  We  strongly  recommend  that  readers  who  are  unfamiliar  with  the  economic 
or  computational  concepts  used  in  the  first  part  of  the  paper  refer  to  these  appendices. 
Supplementary  remedial  readings  are  also  suggested  in  each  appendix. 

1.1  Rational  Expectations:  a  limitation 

We  use  the  exposition  in  Wan  [16]  to  summarize  rational  expectations; 

•  Individuals  form  subjective  probability  distributions  over  future  events. 

•  These  distributions  agree  with  the  objective  probability  distribution  of  events  based 
on  given  information. 

•  This  information  includes  past  history,  government  policy  and  the  set  of  relations 
and  functions  that  make  up  the  general  environment. 

•  Based  on  this  information,  a  known  outcome  follows. 

Thus,  in  order  for  rational  expectations  to  hold,  facts  that  follow  from  and  only  from 
an  agent’s  information  must  be  available  to  the  agent.  In  this  paper,  we  show  that  there 
exist  facts  that  follow  from  and  only  from  an  agent’s  information  that  are  not  computable 
by  that  agent  even  if  (s)he  knows  the  complete  specification  of  the  economy  (see  figure 
1).  Rational  expectations  as  it  is  widely  understood  today  shows  no  awareness  of  this 


3 

phenomenon.  While  this  result  is  philosophical  in  nature,  it  should  be  of  concern  to  a 
variety  of  economists.  In  section  3  we  outline  a  few  examples  in  which  undecidability  is 
a  concern.  The  work  of  Spear  [12]  is  related  to  this  subject. 
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2  The  Problem 

2.1  Introduction 

In  this  section,  we  will  state  a  problem  for  a  finite  closed  network  economy  and  show 
that  it  is  undecidable.  Intuitively,  our  construction  will  proceed  as  follows.  Suppose 
we  are  given  a  Turing  Machine  specification  x  and  an  input  i.  We  will  construct  an 
economy  S{x)  with  an  agent  a,  and  an  initial  impulse  I{i)  with  the  following  property. 
The  impulse  I{i)  reaches  a  in  £{x)  if  and  only  if  d>,  halts  on  i.  In  other  words,  we  will 
reduce  the  halting  problem  into  a  decision  problem  for  a  finite  closed  economy.  By  doing 
so,  we  will  have  shown  that  the  set  of  such  problems  is  not  recursive.  This  follows  from 
the  fact  that  the  halting  problem  is  not  recursive. 

2.2  Encoding  the  Turing  Machine 

Suppose  the  given  Turing  Machine  is  T  =  (Qr,  T?  J-,  S,  <5t,  go.  9r)  w'here  F  =  {0. 1}.^ 
We  construct  a  new  Turing  Machine  M  that  has  exactly  one  halting  state  g*  such  that 
M  halts  on  exactly  the  same  set  of  inputs  as  T. 

The  set  of  states  of  A4  is  Q  =  QjUlqh}-  The  state  transition  function  of  M.  denoted 
S,  includes  all  the  transitions  of  6t  and  the  following  four  additional  transitions; 


6{qa,0)  =  6{qaA)  =  <5(9r,0)  =  ^(gr,l)  = 


The  reader  may  verify  that  the  resulting  Turing  Machine  M  halts  on  exactly  the  same 
set  of  inputs  as  T.  We  will  now  construct  an  economy  that  mimics  the  behavior  of  M 
and  therefore  mimics  T. 

Our  economy  consists  of  n  agents,  where  n  denotes  the  number  of  states  in  Q.  Each 
agent  corresponds  to  a  unique  state  of  M.  We  represent  the  storage  tape  of  .Vf  by  using 
two  binary  fractions  Oj  and  b,.  Let  go  be  the  symbol  which  the  tape  head  is  currently 
scanning. 

Let  gi,g2,93,---  be  the  successive  symbols  on  the  left  of  go.  and  ho.hi,  h2, ...  be  the 
successive  symbols  on  the  right  of  go.  This  is  shown  in  figure  2.  Then,  we  can  represent 
the  storage  tape  by  using  two  numbers  a,  and 


a. 


9. 

3.-1 


(1) 


h, 

ji+i 


1=0 


19) 


Turing  Machine  moves  can  be  divided  into  two  cases,  left  moves  and  right  moves. 
Thus  we  consider  two  cases  of  6: 


®This  assumption  on  F  does  not  reduce  the  computational  power  of  the  Turing  Machine, 

*We  use  3  in  the  denominator  of  our  expressions  for  a,  and  b,.  [9|  use  2  in  the  corresponding  place. 


Tape 


•  •  •  g3  g2 

gi  i  go  I  ho 

hj  ;  I12 ;  hg  i  IX}  hj  .  .  . 

_ 

Read \ Write  Head 

Finite 

Control 

Figure  2:  Schematic  diagram  of  a  Turing  Machine  with  alphabet  {0. 1}. 

Note  that  5,,  h,  €  {0, 1}. 


Case  1:  6{q,c)  =  L) 

Case  2:  6{q.,c)  -  {q',w,R) 

Here,  q  is  the  current  state  of  My  q'  is  the  next  state  of  M,  c  e  {0, 1}  is  the  symbol 
below  the  tape  head,  and  w  £  {0, 1}  is  the  symbol  which  the  tape  head  writes  on  the 
tape.  L  represents  a  left  move,  and  R  represents  a  right  move.  We  now  map  the  state 
transition  function  6  into  the  transition  operation  of  an  economy  as  follows; 


Case  1:  Left  move  6{q,  c)  =  (<?',  L).  Let  at  and  bf,  be  the  values  of  a,  and  6.,  respectively 

after  this  transition.  Then,  at  and  bb  can  be  written  as: 


i=i 


T7  =  Sfo-  -  f) 


W  1^  hy 

3  h  3'*‘ 


3 


3  3 


Case  2:  Right  move  6{q,c)  =  {q',w,R).  In  this  case  and  bb  can  be  written  as: 


(3) 

(4) 


b-Q 

3 


+ 


w 

"9 


1  00 


<7. 

3'+‘ 


ho  w  a, 
_  _ 


3£. 

3 


ab  = 


3 


bb  —  3  ^ 


h, 

3.^1 


3(6. 


bp 

3 


ft 

(6) 


In  the  next  few  sections  we  present  agents  who  perform  the  very  transformations 
listed  above,  and  then  redirect  the  injpulse  to  the  agent  correspcnding  to  the  new  state 
of  A4.  Thus  our  economy  will  simulate  the  above  Turing  Machine. 


2.3  A  Basic  Economy 

Given  the  Turing  Machine  and  its  encoding,  we  can  construct  an  economy  as  follows. 
Each  state  of  the  Turing  Machine’s  finite  control  is  represented  by  a  unique  agent  of  the 
economy.  The  computation  of  the  Turing  Machine  is  encoded  as  an  impulse  that  flows 
through  the  economy.  At  any  instant  this  impulse  wall  reside  at  exactly  one  agent.  This 
agent  corresponds  to  the  current  state  of  the  finite  control  of  the  Turing  Machine."’  The 
magnitude  of  the  impulse  represents  the  value  of  the  tape  of  the  Turing  Machine. 

When  an  agent  receives  an  impulse,  it  optimizes  its  utility  function  and  transmits 
a  new  impulse  to  one  of  two®  neighbors  (see  figure  3).  The  choice  of  the  neighbor  to 
whom  the  impulse  is  transmitted  depends  on  the  state  transition  function  of  the  Turing 
Machine  as  follows.  A  state  transition  from  a  to  a'  of  the  given  Turing  Machine  is 
encoded  by  an  impulse  transmitted  by  the  agent  corresponding  to  a  towards  the  agent 
corresponding  to  cr'.  The  optimization  function  of  each  agent  is  designed  to  ensure  that 
the  dynamics  of  the  economy  mimic  the  computation  of  the  given  Turing  Machine. 

Since  the  number  of  states  of  the  given  Turing  Machine  is  finite,  the  number  of  agents 
in  the  economy  is  also  finite.  The  intensity  of  the  received  impulse  plays  an  important 
role  in  deciding  with  whom  the  receiving  agent  is  going  to  interact.  The  process  of 
reoptimization  may  result  in  the  absorption  or  magnification  of  some  of  the  intensity  of 
the  impulse.^ 


2.4  An  Undecidable  Economy 

We  consider  the  following  economy:  there  are  four  consumer  goods,  a,  b,  c  and  d,  and  a 
leisure  good  1.  The  economy  consists  of  a  variety  of  agents  who  can  consume  any  or  all 
of  these  goods,  but  can  produce  either  one  unit  each  of  a  and  b,  or  one  unit  each  of  c 
and  d  only.  The  goods  in  each  production  pair  are  referred  to  as  related  goods.  Each 
agent  can  buy  goods  from  either  a  producer  of  a  and  6,  or  from  a  producer  of  c  and  d. 
Goods  are  bought  by  transforming  leisure  into  labor,  at  the  constant  marginal  cost  of  1. 
Figure  3  shows  a  section  of  the  economy. 

®This  statement  has  a  small  technical  flaw.  In  Appendix  3  we  discuss  this  flaw  and  present  a 
specification  for  the  economy  which  overcomes  this  flaw.  We  have  avoided  this  technical  discussion  in 
this  section  to  make  this  paper  easier  to  read. 

®The  problem  can  be  generalized  to  a  problem  of  choosing  among  many  choices. 

^This  model  is  motivated  by  a  discrete-choice  making  process  which  results  from  an  impulse.  .4r, 
example  is  an  agent  faced  with  a  finite  number  of  possible  actions,  of  which  he  must  choose  one,  His 
action  causes  the  agent  he  interacts  with  to  adjust  his  behavior,  and  so  on. 
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Endowment: 
Utility:  U  = 


V 

i  Endowment:  (a,b) 

\  Utility:  U  =  Ul(a,b 


(a,b)  (2 

U2(a,bx,d,l) 


\ 

/ 


3  )  Endowment: 
\  Utility:  U  - 


.C,d,l; 

(c,d) 

U3{a,b,cyi.i) 


Figure  3;  A  section  of  the  economy 


Following  are  the  variables  used  in  this  analysis. 

is  =  quantity  of  good  i  sold  to  the  preceding  agent  in  a  period 
lb  -  quantity  of  good  i  bought  from  the  subsequent  agent  in  a  period 
ic  =  quantity  of  good  ?  consumed  in  a  period 


where  i  is  one  of  the  four  consumer  goods.  The  utility  function  of  agent  j  i 
general  form: 

A 

s  of  the 

U,=Y^K„iJ+l 

1=1 

(7) 

where 

=  k{{is}U). 

(8) 

Thus  the  utility  function  is  continuous  and  concave  in  and  d^.  The  parameter 

Kij  is  a  function  of  the  quantity  of  produced  goods  sold  by  agent  j.  We  motivate  this 
by  an  ‘information  effect’  on  an  agent’s  utility  function. 

Figure  10  in  Appendix  2  shows  the  different  values  that  K,j  can  take  on  for  producers 
of  a  and  b.  Tt^e  corresponding  values  of  K,j  for  producers  of  c  and  d  are  obtamed  by 
replacing  a,  with  c,,  bs  with  d,,  ab  with  C6,  etc. 

The  constant  K^j  for  any  good  is  a  function  of  i,,  where  i  is  the  good  itself  or  the 
related  good.  The  motivation  for  i,  entering  Ktj  is  as  follows.  An  agent’s  marginal  utility 
for  a  good  depends  on  how  much  of  the  good  itself  and  the  related  good  the  agent  sold. 

We  now  emphasize  some  aspects  of  the  economy.  Note  that  ail  utility  functions  are 
concave  (weakly  so  in  the  case  of  leisure)  and  increasing  in  their  arguments.  The  economy 
has  heterogeneous  agents,  i.e.,  different  agents  may  have  different  utility  functions.  Thus 
the  economy  is  consistent  with  traditional  assumptions  of  economic  theory. 
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We  now  solve  the  optimization  problem  for  one  possible  tj  pe  of  «  and  6  pnotiiKaM . 
See  Appendix  2  for  the  solutions  to  the  problems  for  all  types  of  u  and  b  producers.  I  he 
solution  to  the  problem  for  the  c  and  d  producer  is  similar  and  is  left  to  the  reader. 

The  first  case  of  Appendix  2  -s  solved  below.  This  case  corresponds  to  tlu'  toilowing 
transition  in  the  Turing  Machine  simulation.  The  value  in  the  tape  ceil  below  the  tape 
head  of  the  Turing  Machine  is  1.  The  state  transition  function  of  M  for  the  current 
state  requires  the  tape  head  to  write  a  I  and  move  to  the  left. 

In  this  case,  the  agent  chooses  to  buy  a  and  6.  The  consumer's  problem  is; 


Max  r  = 


2(2n,)^al  -eO.lc^ 


O.Idl  -  / 


subject  to 


«<•  =  I  —  U,  —  «(, 

6,  =  1  -  b,  -  bb 

Cc  =  a 

(10) 

(in 

(12) 

dc  =  db 

(13,1 

The  first  order  conditions  for  an  optimum  are: 

(2a,)Uc~'  =  1 

(14) 

(  3  )^i>c  ^  =  1 

(15) 

0.05c;’  =  1 

(16) 

0.05d;’  =  1 

(17) 

This  condition  will  hold  for  the  two  goods  which  were  bought;  the  agent  will  not  be 
willing  to  work  for  wages  beyond  this  point,  because  leisure  will  be  more  valuable  at  the 
margin.  Because  of  the  restriction  on  choice,  the  first  order  conditions  will  not  hold  for 
the  two  goods  which  were  not  bought. 

If  a  and  b  are  bought,  then  =  2a,  and  at  =  3aj  -  1.  Similarly,  be  =  |(2  -  b,)  and 
fit  =  |(1  -f  If  c  and  d  were  to  be  bought,  then  =  Ct  =  ^  and  dc  =  db  =  It  can 
be  checked  that  the  utility  from  buying  ct  and  dt  is  lower  than  the  utility  from  buying 
at  and  6f  Thus  a  and  b  are  bought  and: 


Cfc  =  3a,,  -  1 


bb  = 


1  +6, 


(18) 


(19) 


Recall  that  in  this  case  the  value  of  the  tape  cell  below'  the  tape  head  go  is  1.  It  is 
easy  to  verify  the  the  impulse  passed  on  to  the  next  agent,  i.e.,  (at.ht)  corresponds  to 
the  case  in  which  the  tape  head  writes  a  1  and  then  moves  left  (see  Equations  3  and  4). 


y 

The  optimizatior  problem  for  the  other  types  of  a  and  b  producer  end  for  die  c  and 
d  producers  can  be  solved  in  an  analogous  manner.  A  summary  of  the  coeflicients  k,^ 
for  these  cases  appears  in  the  figure  in  Appendix  2.  Thus  we  have  simuiaied  a  Turitig 
Machine  using  a  simplistic  economy  consisting  of  producers  and  corrsumers  who  must 
make  discrete  choices. 

2.5  Correspondence  between  the  Turing  Machine  and  the  Econ¬ 
omy 

In  the  introduction  to  this  section  the  stated  problem  was  whether  an  impulse  lit)  reaches 
an  agent  a.  We  can  now  relate  these  elements  of  the  economy  to  the  corresponding 
elements  of  the  given  Turing  Machine  M. 

•  The  agent  a  correspondt  to  the  halting  state  of  .Ad. 

•  The  initial  shock  to  the  economy  is  determined  as  follows.  Let  i  denote  the  initial 
value  of  the  tape  of  M.  Then  /(f),  the  initial  shock  to  the  economy  is  (u,,h,)  as 
defined  in  Equations  1  and  2. 

In  summary,  our  construction  mimics  M  as  follows.  M  halts  on  input  f  if  and  only  if 
an  initial  shock  /(f)  reaches  a  in  S(x). 

2.6  The  Problem  is  Recursively  Enumerable 

In  our  model  economy,  the  path  along  which  the  impulse  travels  can  be  partitioned  into 
agent-to-agent  subpaths.  Since  each  subpath  is  an  element  of  the  solution  to  a  simple 
problem,  the  total  path  can  be  determined  by  a  rational  agent.  Thus  the  problem  is  in 
principle  solvable,  and  a  Turing  Machine  is  capable  of  enumerating  all  the  perturbations 
which  will  ultimately  affect  a  given  agent.  The  problem  is  thus  recursively  enumerable. 

In  the  next  section  we  show  that  the  problem  is  not  recursive,  i.e.,  a  Turing  Machine  is 
not  capable  of  enumerating  all  the  perturbations  that  never  affect  a  given  agent. 

2.7  Undecidability  Proof 

We  have  shown  our  system  and  its  relation  to  the  Turing  Machine.  By  simulating  each 
state  as  an  agent  and  routing  the  impulse  between  the  agents,  we  can  simulate  any 
Turing  Machine.  Thus  we  have: 

Theorem  1  The  following  language  is  undecidable: 

{{!,£,  a)\  initial  impulse  1  reaches  agent  a  in  economy  E] 

R.ecall  that  the  Universal  Turing  Machine  can  be  used  to  simulate  any  Turing  Machine 
on  any  input.  Let  u  denote  the  specification  of  any  Universal  Turing  Machine  and  let 
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S{u)  denote  the  economy  that  rniniics  u.  Let  a  denote  the  agent  in  <f(uj  corresponding 
to  the  halting  states  of  u.  For  any  Turing  Machine  specification  x  and  input  i.  Ox  halls 
on  input  i  if  and  only  if  the  initial  shock  I{{x,i))  reaches  a  in  £(u).  Thus  there  is  a 
particular  finite  economy  <f(ii)  with  a  particular  agenl  a  for  which  we  can  show: 

Theorem  2  The  following  language  is  undecidahle: 

{/j  initial  impulse  I  reaches  agent  a  in  economy  i’(a)} 

We  encourage  the  reader  to  contrast  the  statements  of  Theorems  1  and  2. 
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3  Applications  and  Limitations 

3.1  Applications 

In  this  section  we  mention  a  few  areas  in  which  the  concept  of  undecidability  is  applicable. 
The  areas  are  trigger  problems  in  macroeconomics,  game  theory  and  spectral  analysis  in 
econometrics.  For  all  of  these  examples,  consider  the  kind  of  network  economy  presented 
in  section  3. 

•  Trigger  Problems  in  a  Multi-Sector  Economy® 

Consider  a  node  of  an  economy  which  releases  a  significant  impulse  T  if  it  receives 
an  impulse  /i.  If  the  question  of  whether  impulse  Ii  ever  passes  through  the  node 
is  undecidable,  then  no  economist  or  agent  with  rational  expectations  will  know 
whether  the  significant  impulse  I2  is  evei  going  to  be  released.  In  this  framework, 
our  modelling  capability  and  rational  expectations  are  compromised. 

•  Game  Theory  -  a  dynamic  example 

Consider  a  repeated  dynamic  game  whose  extensive  form  looks  like  the  economy 
Ej.  Then  each  node  in  the  tree  represents  a  move  by  a  player.  The  problem  of 
whether  the  game  passes  through  a  given  node  is  undecidable. 

•  Spectral  Analysis  in  Time  Series  Econometrics 

In  the  above  economy,  the  question  of  whether  or  not  an  impulse  passes  through 
a  certain  node  of  an  economy  is  undecidable.  Thus  a  time  series  econometrician 
collecting  data  at  that  node  can  never  be  sure  that  (s)he  has  a  complete  set  of 
data,  because  (s)he  will  never  know  when  to  stop  collecting  data. 

The  above  examples  are  a  small  subset  of  the  conceivable  range  of  undecidable  prob¬ 
lems. 


3.2  Limitations 

It  is  important  to  recognize  the  limitations  of  this  result.  A  number  of  traditional 
problems  are  decidable.  Examples  are  certain  problems  involving  homogeneous  agents, 
convergent  infinite  sequences  and  finite  time  horizons.  These  problems  can  be  solved  by 
a  suitably  encoded  Turing  Machine.  To  the  extent  that  economists  are  satisfied  with  the 
realism  of  such  problems,  the  issue  of  undecidability  is  not  important.  However,  should 
economists  try  to  model  the  world  as  it  actually  is,  in  terms  of  a  network  of  interacting 
sectors  or  agents  making  discrete  choices,  the  issue  of  undecidability  must  certainly  play 
a  role  in  their  concept  of  knowledge  in  economies. 


®Modelb  which  attempt  to  closely  mimic  macroeconomic  reali-y,  such  as  Competitive  General  Equi¬ 
librium  (CGE)  models,  are  also  the  types  of  models  which  are  most  susceptible  to  the  problem  of 
undecidability. 


4  Conclusion 


12 


In  this  paper  we  have  shown  that  certain  problems  in  economics  are  utidecidabk.  I'his 
provides  a  formal  basis  for  challenging  the  validity  of  the  rational  expectations  hypothesis 
in  the  context  of  such  economies.  The  argument  is  that  there  are  facts  which  follow  from 
and  only  from  an  agent's  information  which  the  agent  cannot  compute.  Philosophically, 
undecidabiiity  illuminates  a  problem  for  economists:  there  are  fragments  of  economics 
about  which  it  may  not  be  possible  to  reason. 


Appendix  1 

In  section  2  we  showed  that  the  execution  of  any  given  Turing  Machine  can  be  mimicked 
by  the  corresponding  economy.  In  this  appendix  we  illustrate  a  minor  technical  flaw  in 
our  construction  and  show  how  it  can  be  corrected.  We  first  illustrate  the  flaw  with  an 
example. 

Suppose  ^0  and  qi  are  states  of  the  given  Turing  Machine  such  that  <f(?,  1)  = 
{qi,x,y)  for  some  x  and  y,  and  <5(9,0)  =  {qQ,x'.y')  for  some  x'  and  i/.  Then  the  economy 
has  three  agents  a,  Oi  and  Oq  that  correspond  to  the  states  q,  and  90  respectively. 
Our  construction  requires  oi  to  be  a  producer  of  a  and  6,  and  Oo  to  be  a  producer  of  c 
and  d. 

Further  suppose  that  q'  is  another  state  of  the  given  Turing  Machine  such  that 
^(9',0)  =  {qi,x,y)  for  some  x  and  y.  Our  construction  requires  Qj  to  be  producer 
of  c  and  d.  In  this  situation  our  construction  fails.  Figure  4  shows  the  flawed  economy. 


Figure  4;  A  construction  of  the  economy  showing  the  technical  flaw. 

We  overcome  this  problem  by  converting  the  Turing  Machine 

T  =  (g,r,T,S,^,9o,9a,9r) 
into  the  modified  Turing  Machine 

T  =  (Q',r,l.,E,(5',(«';o,0),{9„0),(9.,0)) 

as  follows: 

•  Q'  =  Q  X  {0,1}.  In  other  words,  every  state  9  of  Ad  is  represented  by  two  states 
of  M':  (9, 0)  and  (9, 1). 


•  8’  mimics  6  as  follows.  Let  q  be  any  state  of  M.  Suppose  that  M  changes  state 
from  Q  to  q'  upon  reading  i,  i.e.,  Slq.i)  =  (q\x.i/)  for  some  x  and  u.  Then 
8'((q,0),i)  =  S'((qA},i)  =  ((q\i),x,p}. 

•  To  correctly  address  the  halting  condition,  we  also  add  the  following  transitions: 

S'((q,A},0}  =  S'((qaA),l)  =  ((qa.0}.UR) 

6'((qr,  1),0)  =  S'i(qr,  1).  1)  -  ((//.,  0),  1,  /^) 


q  q’ 


Figure  5:  A  construction  of  the  economy  used  to  overcome  the  technical  flaw. 


Figure  5  is  a  visual  representation  of  the  above  construction.  It  is  easy  to  verify  that 
L(M'}  =  L{M.)  and  that  our  construction  works  correctly  with  M' ■  In  summary,  given 
any  arbitrary  Turing  Machine  M,  we  first  modify  it  into  another  Turing  Machine  M'  as 
described  in  this  appendix  and  then  convert  M'  into  an  economy  using  the  techniques 
of  section  2. 


Appendix  2 


o 


t  [ij  denotes  the  greatest  integer  less  than  or  equal  to  x.  Note  that  [3^, J  =  ho  of 
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Appendix  3 

Optimization  for  the  Recursion  Theorist^ 

An  Economy 

An  economy  consists  of  a  set  of  people  or  groups  of  people,  referred  to  as  agents,  that 
produce,  trade  and  consume  goods.  The  endowment  of  an  agent  at  any  time  is  the  set 
of  goods  produced  or  acquired  by  that  agent  prior  to  that  time  and  currently  within  its 
possession.  For  example,  the  endowment  of  a  farmer  today  may  be  100  tons  of  rice,  the 
endowment  of  an  investor  may  be  twenty  shares  in  Imperial  Chemical  Industries  etc. 

Each  agent  in  the  economy  consumes  goods  to  satisfy  its  needs  or  to  derive  pleasure. 
By  consuming  different  mixes  of  goods,  an  agent  derives  different  amounts  of  utility.  For 
example,  consuming  1  apple  and  1  orange  might  yield  a  different  utility  from  consuming 
2  apples  and  1  banana.  The  utility  of  an  agent  is  quantitatively  captured  by  a  utility 
function.  Each  agent  tries  to  maximize  its  utility  function.  Note  that  (1)  different  agents 
may  have  different  utility  functions  and  (2)  the  utility  function  of  any  given  agent  may 
be  affected  by  the  past  behavior  of  that  agent  and  by  the  behavior  of  other  agents. 

Utility  Maximization 

In  practice,  economists  assume  that  utility  functions  are  concave. This  captures  the 
observation  that  in  most  cases,  every  addition  i  unit  of  a  good  consumed  gives  less 
additional  pleasure. 

In  order  to  maximize  their  utility  function,  agents  may  trade  a  part  of  their  endow¬ 
ment  with  each  other.  For  example,  consider  an  economy  in  which  there  are  tw'o  agents 
A  and  O.  A  is  an  apple  farmer  whose  endowment  is  10  apples  and  O  is  an  orange  farmer 
whose  endowment  is  10  oranges.  A’s  utility  function  Ua  is 

Ua{Q;0)  ~  2o5  -t-  0^ 


and  O’s  utility  function  Uq  is 


Uo{a,o)  =  2a^  +  3o2 


If  A  and  O  do  not  trade,  A's  utility  will  be  t//i(10,0)  =  2vT0  r;  6.3.  Similarly,  O’s 
utility  will  be  approximately  9.5.  Suppose  A  and  O  agree  to  trade  1  apple  for  1  orange. 
A’s  utility  will  be  0^(9, 1)  =  7  and  O’s  utility  will  be  f/o(9, 1)  =  11-— both  benefit  from 
the  transaction.  In  fact,  A  would  be  even  happier  if  (s)he  could  trade  2  apples  for  2 
oranges. In  order  to  determine  when  A  will  be  happiest,  we  need  to  solve  the  following 
constrained  optimization  problem  for  a  and  o: 

®[11]  provides  a  thorough  treatment  of  this  subject. 

'“This  convenient  assumption  has  never  been  proved,  and  is  not  always  validated  by  observed  behavior. 

“To  keep  things  simple  in  this  example,  we  assume  that  1  apple  is  always  traded  for  exactly  1  orange. 


subject  to 


i  J 

Max('A(a,o)  =  2a^  4- 

a  4-  o  =  10. 

known  as  the  budget  constraint  and 


a  >  0,  o  >  0 


known  as  nonnegativity  constraints. 

Using  the  method  of  Lagrange,  we  derive 

dUA{a,o)  _  dUA(a,  o) 
da  do 

knowm  as  the  marginality  condition. 

The  function  is  referred  to  as  the  apple  farmer’s  marginal  utility  of  a  and 

is  referred  to  as  the  apple  farmer’s  marginal  utility  of  o.  In  most  cases, given  a 
concave  utility  function  /  in  n  goods  gi,g2,---  5n>  the  maximum  utility  can  be  determined 
by  equating  all  n  marginal  utilities  of  /  (i.e.,  with  respect  to  each  of  the  n  goods). 

In  this  paper  we  consider  a  finite  economy,  i.e.,  one  with  a  finite  number  of  agents. 
Each  agent  has  a  set  of  neighbors  with  whom  it  can  perform  transactions.  This  is  indeed 
the  case  in  practice,  since  an  agent  can  only  interact  with  other  agents  that  are  “nearby’’. 
In  other  words,  if  the  physical  or  temporal  distance  between  two  agents  is  sufficiently 
large,  they  cannot  trade  with  each  other. 

We  assume  that  time  progresses  in  discrete  units.  In  each  time  unit,  an  agent  makes 
a  decision  based  on  its  endowment  and  its  utility  function,  and  may  participate  in  a 
transaction  with  one  of  its  neighbors. 

We  subject  this  economy  to  an  exogenous  shock.  An  example  of  an  exogenous  shock 
is  an  increase  in  the  endowment  of  an  agent.  In  practice,  this  may  be  achieved  by  reduced 
taxation,  low-interest  loans,  an  outright  grant  etc.  As  economists,  we  wish  to  determine 
what  effect  that  this  action  will  have  on  the  economy.  In  particular,  we  wish  to  determine 
whether  an  agent  A  will  be  affected  if  an  agent  B's  endowment  is  increased.  In  practice, 
this  ability  helps  in  policy  decision  making.  For  example,  consider  a  government  that 
would  like  ensure  that  all  its  citizens  receive  at  least  a  subsistence  amount  of  food.  One 
possible  way  of  achieving  this  goal  would  be  to  provide  a  subsidy  to  all  farmers  in  the 
economy  and  hope  that  some  of  the  benefit  in  reduced  food  production  “costs”  is  passed 
on  to  the  poor. 

Thus  the  government  wants  to  solve  the  following  problem;  if  the  endowment  of  the 
farming  sector  is  increased,  will  the  poor  benefit  sufficiently?  More  generally,  we  can 
study  the  following  abstract  problem:  if  the  endowment  of  an  agent  A  is  increased,  will 
another  agent  B  be  affected? 


common  exception  is  a  “corner”  solution. 
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We  show  that  in  general,  this  problem  is  undecidabie.  Given  an  arbitrary  Turing 
Machine  T,  we  show  how  to  construct  an  economy  £j  in  which  an  agent  B  is  affected 
by  the  perturbation  if  and  only  if  T  halts  on  an  empty  tape.  I'echnically,  this  result  is 
similar  to  showing  that  a  ray  tracing  problem  is  undecidabie  [9]. 
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Appendix  4 

Introducing  Recursion  Theory  to  Economists 

Introduction 

In  this  section,  we  go  over  some  key  concepts  in  recursion  theory.  An  understanding  of 
these  concepts  is  necessary  for  an  understanding  of  the  result  of  this  paper.  First,  we 
define  some  terms  necessary  for  an  understanding  of  recursion  theory.  Then,  as  a  step 
toward  understanding  the  Turing  Machine,  w^e  present  a  weaker  and  simpler  computa¬ 
tional  device  called  the  Deterministic  Finite  Automaton.  The  concept  of  a  Deterministic 
Finite  Automaton  also  serves  to  emphasize  the  power  of  the  Turing  Machine.  Finally, 
we  introduce  the  Turing  Machine  and  state  si)me  fundamental  theorems  that  we  will  use 
to  derive  our  result. 

This  section  summarizes  the  exposition  on  Deterministic  Finite  Automata  and  Turing 
Machines  in  [5,  6]:  we  make  extensive  use  of  the  language  and  organization  of  [5,  6]. 

Basic  Definitions 

In  this  section  we  introduce  the  economist  to  Recursion  Theory.  We  provide  the  defini¬ 
tions  of  terms  used  in  sections  4  and  4.  A  more  detailed  treatment  of  these  concepts  is 
available  in  [5]. 

Definition  1  An  alphabet  is  a  finite  set  of  symbols. 

For  example  consider  the  set  of  equations  in  elementary  calculus.  The  alphabet  for  this 
set,  denoted  S,,  contains  the  following  symbols: 

1.  The  digits,  0, 1, ...  9. 

2.  The  decimal  point, 

3.  A  finite  set  of  connectives  and  operators,  -f ,-,  x ,  -p,  ^  ,=,(,),  9,  d,  /,  lim,  sin. 
cos,  etc. 

4.  A  finite  set  of  variables  x,y,  etc. 

5.  A  finite  set  of  constants  tt,  e,  etc. 

Clearly,  this  set  of  symbols  is  finite.  We  use  the  symbol  S  to  denote  an  arbitrary  alphabet. 

Definition  2  A  string  over  an  alphabet  S  is  a  finite  list  of  symbols  belonging  to  the  set 

E. 

For  example, 


dy-^dx  —  x^2  e''{~x) 

is  a  string  over  E,,  the  alphabet  for  the  set  of  equations  in  elementary  calculus. 


(20) 
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Definition  3  The  concatenation  of  two  stritigs  x  and  y  is  denoted  by  xy. 

Definition  4  S*  denotes  the  set  of  all  strings  over  the  alphabet  E. 

Definition  5  The  length  of  a  string  x,  denoted  jxj  is  the  number  of  symbols  in  x. 

For  example,  the  length  of  the  string  in  Equation  20  is  16. 

Clearly  not  all  strings  over  Hi  belong  to  the  set  of  true  equations  in  elementary 
calculus.  For  example  consider  the  following  strings: 

1.  “x(”  is  not  well- formed.  It  violates  the  rule  that  the  number  of  open  parentheses 
in  an  equation  should  equal  the  number  of  closed  parentheses  in  an  equation. 

2.  “1  =  2”  while  well-formed,  is  false. 

Informally,  the  concept  of  a  language  is  used  to  differentiate  between  '‘acceptable"  and 
“unacceptable”  elements  of  H*.  Thus  the  two  unacceptable  strings  above  do  not  belong 
to  the  language  of  equations  in  elementary  calculus. 

Definition  6  A  language  over  H  is  a  subset  ofH". 

A  decision  problem  is  specified  by  a  set  A  of  all  possible  inputs  and  B  C  A  of 
“acceptable”  instances.  For  example  the  following  is  a  decision  problem:  is  a  specific 
sector  in  an  economy  affected  by  a  trade  shock.  The  set  of  inputs  is  the  set  of  all  possible 
trade  shocks  to  the  economy.  The  subset  of  “acceptable”  instances  is  the  set  of  all  trade 
shocks  which  affect  the  specified  sector. 

Definition  7  A  decision  problem  overH  is  a  function  from  S*  that  returns  a  “yes’"  or 
“no”  answer. 

Systems,  States  and  Transitions 

Intuitively,  a  system  is  a  set  of  agents  and  relations  connecting  the  agenS.  The  state  of 
a  system  is  a  complete,  instantaneous  description  of  the  system.  In  particular,  the  state 
of  system  provides  all  relevant  information  about  each  agent  in  the  system  and  the 
relations  connecting  them  at  the  given  instant. 

Every  system,  is  governed  by  a  set  of  laws  called  the  state  transition  function  of  that 
system.  The  state  transition  function  determines  how  the  state  of  the  system  evolves 
over  time.  For  simplicity,  we  assume  that  the  state  transitions  occur  instantaneously. 

As  an  example,  we  consider  the  following  economy  with  n  agents  that  trade  in  a 
common  market.  Each  agent  a  has  a  utility  function  Ua  which  it  tries  to  maximize. 
The  endowment  of  a  at  time  t  is  denoted  by  Ea{t).  At  the  end  of  time  period  t,  agent 
a  selects  Xa  units  of  one  commodity  Ca  from  its  endowmeiit  and  exchanges  it  for  other 
commodities  from  other  agents.  In  exchange  for  Ca,  agent  a  acquires  a  basket  of  goods. 
ba. 

The  state  of  this  system  at  time  t  is  an  n-tuple  ...,Ea„{t)).  The  state 

transition  function  of  this  system  is  the  solution  of  the  utility  maximization  problem  for 
each  agent.  Thus  if  we  are  given  each  agent’s  utility  function  and  the  current  state  of 
this  system,  then  we  can  determine  how  the  system  will  evolve  over  time. 


The  Deterministic  Finite  Automaton 

In  this  section  we  briefly  describe  a  simple  class  of  computing  devices  known  as  Deter¬ 
ministic  Finite  Automata.  We  use  some  of  the  notation  of  joj  and  [61 

Definition  8  A  Deterministic  Finite  Automaton  is  a  3- tuple 

where; 

1.  Q  is  the  finite  set  of  states  of  M 

2.  S  is  the  finite  alphabet  of  M. 

3.  S  :  Q  X  E  Q  is  tne  state  transition  function  of  M. 

4.  Qo  E  Q  is  the  initial  state  of  M. 

5.  A  C  Q  is  the  set  of  accepting  states  of  M. 

The  Deterministic  Finite  Automaton  M  works  as  follows.  It  starts  in  its  initial  state. 
5o-  At  each  time  period,  it  reads  one  symbol  from  its  input  and  changes  its  state  based 
on  its  state  transition  function.  We  say  that  M  accepts  it  at  the  end  of  its  input  it  is  in 
an  accepting  s^ate,  i.e.,  a  state  in  A.  Otherwise,  we  say  that  ,V1  rejects.  Thus  the  set  of 
inputs  on  which  M  accepts  defines  a  language  on  E. 

Definition  9  If  on  input  x,  M  accepts,  we  say  M  accepts  x. 

Definition  10  The  language  of  a  Deterministic  Finite  Automaton  M,  denoted  L{M). 
is  {x  €  T,*\M  accepts  x}. 

Definition  11  A  set  S  C  S*  is  called  regular  if  and  only  if  there  is  a  Deterministic 
Finite  Automaton  M  such  that  L(M')  =  S. 

An  Example 

As  an  example  consider  M,  a  Deterministic  Finite  Automaton  that  accepts  {a;  €  {a,  h}’b- 
does  not  contain  the  substring  aba}.  The  set  of  states  of  M  is  92' 93}-  The 

alphabet  of  M  is  {a,  h}.  The  initial  state  of  M  is  90.  The  set  of  accepting  spates  of  M  is 
{90, 9i,  92}.  The  state  transition  function  of  M  is  given  in  figure  6.  To  illustrate  how  M 
functions,  we  show  all  the  state  transitions  of  M  when  its  input  is  aaabba.  See  figure  7. 
When  M  reads  the  last  symbol  (;f  the  input  (i.e.,  0),  M  enters  the  state  91.  M  accepts 
aaabba  because  91  is  an  accepting  state  of  M. 

As  mentioned  earlier,  Deterministic  Finite  Automata  have  limited  computing  powder. 
This  is  illustrated  by  a  theorem  known  as  the  pumping  lemma.  This  theorem  states  that 
there  is  no  Deterministic  Finite  Automaton  that  accepts  certain  sets  of  strings  that  are 
very  simple  to  specify.  We  next  explain  the  pumping  lemma  briefly  and  show  that  the 
set  {x\x  =  a"fc"  for  some  n}  is  not  regular. 
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Figuie  6:  State  transition  function  for  Detenninistic  Finite  Automaton  .Vt 
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Figure  7;  Deterministic  Finite  Automaton  M  responding  to  aaabba 
The  Pumping  Lemma 

The  intuition  for  the  pumping  lemma  is  the  following.  Consider  a  Deterministic  Finite 
Automaton  M  such  that  L{M )  is  infinite.  Since  M  consists  of  a  finite  set  of  states,  there 
exists  a  sufficiently  long  string  x  e  L{M)  that  will  force  the  automaton  to  repeat  at  least 
one  state.  Thus  x  is  of  the  form  abc  where  q,  the  state  of  after  scanning  a,  is  the  state 
of  after  scanning  ab.  Since  M.  cannot  tell  the  difference  between  two  visitations  of 
the  same  state,  the  state  of  .Vf  after  scanning  abb  must  be  q.  Thus  the  substring  between 
the  two  visitations  of  the  repeated  state  can  be  inserted  into  the  string  before  the  first 
occurrence  of  the  state  and  the  newly  constructed  string  will  still  be  accepted. 

This  observation  can  be  used  to  show  that  the  set  S  =  {xjx  is  of  the  form 
is  not  regular,  i.e.,  there  is  no  Deterministic  Finite  Automaton  that  accepts  precisely 
this  set.  This  is  proven  by  contradiction;  suppose  there  exists  a  Deterministic  Finite 
Automaton  M  such  that  L(M)  =  S.  Take  a  string  of  the  form  such  that  m  is 
greater  than  the  number  of  states  in  M.  There  must  exist  x  and  y,x  <  y  <  m  such  that 
the  state  of  M  after  it  scans  a^,  is  the  same  as  the  state  of  M  after  it  scans  a^.  We 
leave  it  to  the  reader  to  verify  that  M  must  accept  a"’ a  string  that  is  clearly 
not  in  S. 


•  *0’’  denotes  a  .string  of  n  consecutive  a's.  o*  denotes  a  string  of  any  number  of  consecutive  o‘s. 
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Turing  Machines,  Computability  and  Undecidability 
Introduction 

The  Turing  Machine  was  invented  in  193C  by  Alan  Turing  [14!.  It  was  conceived  at  a  time 
when  mathematicians  were  trying  to  define  the  concept  of  computability  of  functions. 
Examples  of  such  efforts  are  Church's  A-calculus  [2j,  Post's  Post  systems  [8j.  Godel's 
/r- recursive  functions  [3],  etc.  Later  mathematicians  showed  that  all  of  the.se  systems  are 
computationally  equivalent,  leading  Church  to  declare  that  each  system  captured  the 
intuitive  notion  of  “computable'’.  This  declaration  is  known  as  Church's  Thesis.  Church's 
Thesis  is  widely  accepted  by  Recursion  Theorists,  and  there  is  no  known  computable 
function  that  cannot  be  programmed  by  a  Turing  Machine.  Recursion  Theorists  mse 
the  Turing  Machine  to  define  computability.  Informally,  a  language  L  is  said  to  be 
computable  if  and  only  if  there  is  a  Turing  Machine  that  accepts  I. 

An  Informal  Description  of  Turing  Machines 

In  this  section,  we  provide  an  informal  description  of  Turing  Machines.  Essentially,  a 
Turing  Machine  is  a  Deterministic  Finite  Automaton  (see  page  21)  augmented  with  a 
one-way  infinite  1  -  dimensional  tape  on  which  it  may  read  and  write  values  (see  figure 
8).  The  tape  of  the  Turing  Machine  is  divided  into  an  infinite  number  of  tape  cells,  each 
of  which  contains  a  symbol  in  P,  an  alphabet  that  contains  S  and  a  blank  symbol  1  ^  E. 
The  Turing  Machine  accesses  the  tape  via  a  single  tape  head.  The  Turing  Machine  may 
read,  write  or  overwrite  a  symbol  on  the  tape  cell  beneath  the  tape  head.  A  state 
transition  for  a  Turing  Machine  consists  of  a  change  in  the  state  of  the  Deterministic- 
Finite  Automaton  associated  with  the  Turing  Machine,  a  command  to  write  a  symbol 
in  the  cell  below  the  tape  head,  and  a  command  to  move  the  tape  head  one  cell  to  the 
left  or  right.  The  input  to  the  Turing  Machine  is  a  finite  string  from  E’  and  is  initially 
written  on  the  tape  in  contiguous  tape  cells  (see  figure  8).  The  infinitely  many  cells  on 
either  side  of  the  input  are  assigned  the  blank  symbol  ±. 

The  Turing  Machine  starts  in  its  initial  state  qo  with  its  head  scanning  the  leftmost 
symbol  of  the  input.  In  each  step  the  Turing  Machine  reads  the  symbol  on  the  tape  cell 
beneath  its  tape  head,  and  depending  on  that  symbol  and  the  current  state  of  the  Turing 
Machine,  it  writes  a  new  symbol  on  that  tape  cell,  moves  its  tape  head  either  one  cell 
left  or  right  and  enters  some  new  state.  The  action  taken  by  the  Turing  Machine  in  each 
situation  is  determined  by  its  state  transition  function  6.  It  accepts  its  input  by  entering 
a  special  accept  state  Qa  and  rejects  its  input  by  entering  a  special  reject  state  Qr-  The 
Turing  Machine  is  said  to  halt  on  input  x  if  it  either  accepts  x  or  rejects  x.  Note  that  it 
may  do  neither,  by  running  infinitely  on  input  x  without  ever  accepting  or  rejecting. 

A  Formal  Description  of  Turing  Machines 
Definition  12  A  Turing  Machine  [5]  is  a  8-tuple 


AA  (^,  F,  T,  E,  f^,./ 


Tape 


alaibialb  b  b  a  b  a 


Read\Write  Head 


I  Finite  i 

Control  I 

_ I 


Figure  8:  Schematic  diagram  of  a  Turing  Machine  with  S  =  {a.b}. 


where: 

1.  <5  is  the  finite  set  of  states  of  M. 

2.  r  is  the  set  of  allowable  tape  symbols  of  M. 

3.  ±  is  the  blank  symbol  of  M. 

4.  E  is  the  set  of  input  symbols  of  M.  Note  that  S  C  F  - 

5.  ^iQxF— ^QxFx  [L,  /?}  is  the  state  transition  function  of  M. 

6-  9o  ^  Q  is  the  initial  state  of  M. 

7.  Qa  ^  Q  is  the  accepting  state  of  M. 

8.  Qt  E  Q  is  the  rejecting  state  of  M. 

Figure  8  is  a  schematic  diagram  of  a  Turing  Machine.  Q  and  qo  for  a  Turing  Machine  are 
the  same  as  Q  and  for  the  Deterministic  Finite  Automaton  of  the  Turing  Machine. 
The  input  to  the  Turing  Machine  is  in  S*  for  some  alphabet  E.  Each  tape  cell  contains 
one  symbol  from  a  set  F,  a  superset  of  E  that  contains  ±,  the  special  blank  symbol.  The 
state  transition  function  of  the  Turing  Machine  now  returns  a  triple  rather  than  just  the 


^*In  some  cases,  E  is  a  proper  subset  of  F  -  {±}.  In  our  example  in  figure  9,  r  =  £u{±,*}. 
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state  of  the  Deterministic  Finite  Automaton  of  the  Turing  Machine.  As  before.  S{q,a) 
describes  the  actions  of  the  Turing  Machine  when  it  is  in  state  q  and  the  tape  cell  below 
its  tape  head  contains  the  value  a.  If  6{q,a)  =  {q'.a'^d).  then  the  operation  of  the  Turing 
Machine  is  as  follows. 

1.  The  Turing  Machine  writes  a'  on  the  tape  cell  below  its  head 

2.  The  Turing  Machine  moves  the  tape  head  in  direction  d  (either  left,  denoted  L  or 
right,  denoted  R). 

3.  T  Turing  Machine  enters  state  cf . 

In  addition,  once  the  machine  enters  the  accept  Qa  or  the  reject  state  q,-.  its  execution 
halts.  If  it  halts  in  qa,  we  say  that  it  accepts.  If  it  halts  in  qj.,  we  say  that  it  rejects. 

Definition  13  If  on  input  x,  M  accepts,  we  saij  M  accepts  x. 

Definition  14  If  on  input  x,  M  rejects,  we  say  M  rejects  x. 

Definition  15  The  language  of  a  Turing  Machine  M,  denoted  L{M),  is  [x  €  E*1.M 
accepts  x} . 

An  Example 

As  an  example,  consider  M,  a  Turing  Machine  that  accepts  the  set  {a”h"c"|n  >  0}.  S. 
the  set  of  input  symbols  of  M  is  {a,  6,  c}.  The  blank  symbol  of  M  is  T.  Apart  from  1 
and  the  symbols  in  E,  F  contains  the  symbol  4^  called  the  erased  symbol.  Thus  the  set 
of  allowable  tape  symbols  of  M  is  {a,b,c, 

Informally,  A4  repeats  the  following  procedure  as  often  as  possible: 

1.  If  there  does  not  exist  at  least  one  each  of  a,  b  and  c,  then  M  stops  and  decides. 

2.  If  there  exists  at  least  one  each  of  a,  6  and  c,  the  head  goes  from  left  to  right  over 
the  input,  erasing  the  first  o,  the  first  b  and  the  first  c. 

3.  The  head  goes  back  to  the  beginning  of  the  input. 

At  the  end,  if  there  is  any  symbol  in  {a,  b,  c}  left,  then  clearly  the  string  is  not  of  the 
form  a^b^c^.  Also  note  that  care  is  taken  to  avoid  strings  of  the  form  abaccb,  i.e..  strings 
with  an  equal  number  of  a’s,  6’s  and  c’s  but  not  of  the  form  a*fe*c*.  The  state  transition 
function  of  M  is  given  in  figure  9. 

Note  that  the  above  set  is  not  regular.  That  is,  we  can  use  the  pumping  lemma  to  show 
that  there  is  no  Deterministic  Finite  Automaton  that  will  accept  this  set.  The  reader  is 
encouraged  to  verify  that  M  actually  accepts  aTb^c^  by  trying  out  a  few  examples. 
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Figure  9:  State  transition  function  for  Turing  Machine  M 
Decision  Problems  and  Recursive  Functions 

In  the  previous  sections,  we  saw  Turing  Machines  that  check  whether  a  given  string  is  in 
a  language.  A  Turing  Machine  can  also  be  used  to  compute  a  function  as  follows.  The 
tape  of  the  Turing  Machine  is  initialized  to  contain  the  parameters  of  the  function;  the 
tape  head  initially  scans  the  leftmost  symbol  of  the  input.  The  output  of  the  function 
is  taken  to  be  the  value  written  on  the  tape  when  the  Turing  Machine  goes  into  its 
accepting  state. 

Definition  16  A  function  f  is  recursive  if  and  only  if  there  is  a  Turing  Machine  M 
such  that  on  every  input  x  in  the  domain  of  f,  M  eventually  writes  f{x)  on  its  tape  and 
enters  its  accepting  state. 

Given  a  Turing  Machine  M  that  computes  a  function  /  and  a  Turing  Machine  ^Vf'  that 
solves  a  decision  problem,  we  can  “concatenate”  M  and  M'  as  follows.  We  can  construct 
a  Turing  Machine  that  first  runs  A4.  W^hen  A4  enters  its  accepting  state,  runs 
Ai'.  Thus  Ad'^  accepts  {x|/(x)  €  L{M')}.  More  precisely,  given 


Ai  =  {Q,  r,  1,  S,  6,  qo,  (ja,  Qt) 


and 

Assuming  for  simplicity  that  Q  and  Q'  are  disjoint,  we  can  construct 

M*  =  {Q\T.±,^,S\q;,q:,g;) 

where 

1.  =  QuQ'-{qa,qr} 

(  6'{q,a)  ifqe  Q' 

2.  (5+(9,a)  =  <  {q',a',d)  if  6 (q,  a)  =  {q',  a',  d)  hnd  q’ ^  qa 

{  {qo,a',d)  if  6{q,a)  =  {q\a!,d)  and  q'  = 


3.  Qo  =  go 

4-  Qa  and  q;  =  q’,. 

M  •  M'  denotes  the  concatenation  of  M  and  M' . 

Decidability  and  Undecidability 

Deflui'-.on  17  .4  set  S  C  S*  is  caZ/cd  recursively  enumerable  (abbreviated  r.t.  'j  if  and 
only  if  there  is  a  Turing  Machine  .M  such  that  L{M)  =  5. 

Definition  18  A  set  5  C  S*  is  called  recursive  if  both  S  and  S  are  recursively  enunur- 
able  4^ 

A  property  is  decidable  if  there  exists  a  Turing  Machine  that  accepts  all  strings  with  that 
property  and  rejects  all  strings  without  that  property. 

Definition  19  A  property  is  decidable  if  and  only  if  the  set  of  all  elements  having  that 
property  is  recursive. 

A  property  is  undecidable  if  there  is  no  Turing  Machine  that  can  determine  whether  an 
arbitrary  given  string  has  that  property. 

Certain  properties  are  undecidable.  For  example,  there  is  no  mechanical  procedure 
that  can  be  used  to  tell  whether  or  not  a  string  causes  a  Turing  Machine  to  halt.  In  par¬ 
ticular,  there  is  no  finite  set  of  axioms  and  inference  rules  that  can  be  used  to  determine 
which  strings  and  Turing  Machines  have  this  property  and  which  do  not. 

Note  that  the  terms  “recursive”  and  “recursively  enumerable”  apply  to  sets.  The 
terms  “decidable”  and  “undecidable”  apply  to  properties  of  elements  of  sets.  By  a 
slight  abuse  of  terminology,  we  say  that  a  language  is  undecidable  if  there  is  no  Turing 
Machine  that  can  determine  whether  an  arbitrary  given  string  belongs  to  that  language. 
[4]  contains  a  good  intuitive  description  of  the  above  concepts. 

Universal  Turing  Machines 

As  we  saw  earlier,  a  Turing  Machine  is  specified  by  an  8-tuple  (Q,  F,  ±,  S,  (f.  go.  ga- gr)- 
It  is  easy  to  encode  this  specification  so  that  the  only  symbols  that  occur  in  it  are  “0" 
and  “1”.  Thus  the  specification  of  the  Turing  Machine  can  be  given  as  a  string  over  the 
alphabet  {0, 1). 

With  this  encoding  technique  in  mind,  we  can  view  the  set  of  specifications  of  all 
Turing  Machines  as  a  language  over  {0,1}.  That  is,  each  specification  of  a  Turing 
Machine  corresponds  to  a  unique  binary  number.  The  Turing  Machine  specification 
corresponding  to  the  number  x  is  denoted 

Note  that  0*  is  not  defined  for  all  x  since  some  numbers  do  not  correspond  to  a  Turing 
Machine  specification.  This  is  notationally  inconvenient.  Thus  if  x  does  not  correspond 


is  used  to  denote  the  complement  of  the  set  S. 


to  a  Turing  Machine  specification,  is  defined  (by  default)  to  be  the  'Funrig  Machine 
that  accepts  0. 

A  Universal  Turing  Machine  is  a  Turing  Machine  whose  language  is  the  set  of  pairs  of 
Turing  Machines  M  and  strings  x  such  that  x  €  L(.V1).  Intuitively,  tlie  Tniversai  Turing 
Machine  is  capable  of  simulating  every  Turing  Machine.  More  precisely,  the  alphaliei  of 
a  Universal  Turing  Machine  is  {0. 1}.  The  Universal  Turing  Machine  accepts  the  string 
{xxy)  if  and  only  if  chx  accepts  y.  To  see  the  construction  oi  „  Universal  Turing  Machine, 
the  reader  is  referred  to  [5]. 

Since  the  Universal  Turing  Machine  is  capable  of  simulating  every  Turing  Machine. 
it  is  capable  of  simulating  itself.  The  property  by  which  a  Turing  Machine  can  simulate 
itself  is  called  self  reference.  This  allows  us  to  use  a  proof  technique  called  diagonahzation 
to  prove  that  some  problems  are  undecidable. 

Diagonalization 

We  first  illustrate  the  method  of  diagonalization  with  what  is  perhaps  its  simplest  ex¬ 
ample. 

Theorem  3  There  is  an  English  sentence  that  is  neither  true  nor  false. 

Proof:  Consider  the  sentence; 

“This  sentence  is  false.” 

Let  us  assume  for  contradiction  that  this  sentence  is  either  true  or  false.  There  are  two 
cases  to  consider; 

1.  The  sentence  is  true.  In  this  case,  the  sentence  is  false — a  contradiction. 

2.  The  sentence  is  false.  In  this  case,  it  is  false  that  the  sentence  is  false,  i.e.,  the 

sentence  is  true — a  contradiction.  □ 

Note  that  the  above  sentence  refers  to  itself. 

The  technique  of  diagonalization  was  first  used  by  Cantor  [4]  at  the  end  of  the  last 
century  to  ,show  that  there  does  not  exist  a  one-to-one  correspondence  between  the 
natural  numbers  N  and  2*  ,  the  power  set  of  N,  which  is  defined  as  follows. 

Definition  20  The  power  set  of  a  set  A,  denoted  2'^,  is  the  set  of  all  the  subsets  of  A. 

Cantor’s  argument  is  as  follows;  Suppose  for  a  contradiction  that  there  is  a  one-to-one 
and  onto  function 


29 


1 

2 

3 

4 

5 

6 

»-* 

8 

9  ...  ; 

/(I) 

1 

0 

0 

1 

0 

0 

1 

0 

0  ...  i 

/(2) 

1 

0 

0 

1 

1 

1 

0 

0 

1  ... 

/(3) 

0 

0 

0 

0 

1 

1 

0 

0 

1  ... 

/(4) 

0 

0 

0 

0 

1 

1 

1 

0 

0  ... 

m 

1 

1 

1 

1 

1 

1 

1 

0 

0  ... 

/(6) 

0 

1 

1 

1 

1 

0 

1 

0 

1  ... 

/(7) 

0 

1 

0 

1 

0 

1 

0 

1 

0  ... 

/(8) 

1 

0 

1 

0 

1 

0 

1 

0 

1  ... 

m 

1 

0 

1 

0 

0 

1 

1 

0 

1  ... 

:  ■ .  1 

Figure  10:  An  example  of  A/  showing  the  relationship  between  .V  and  2'' . 


We  can  build  the  following  infinite  two-dimensional  matrix.  A/; 

vf  -  /  ^  ^ 

0  if;^/(z) 

In  other  words,  each  row  of  M  represents  a  different  function.  The  Isi  row  denotes  /(I), 
the  second  row  denotes  /(2),  and  so  on.  For  example,  figure  10  represents  one  possible 
matrix  M.  /(I)  =  {1,4,7, . . .},  /(2)  =  {1.4, 5, 6,9,. . .},  and  so  on.  By  our  assumption 
that  /  is  onto,  every  subset  of  N  appears  as  a  row  of  the  matrix. 

Now  we  will  use  diagonalization  to  derive  a  contradiction.  Construct  the  complement 
of  the  infinite  string  down  the  main  diagonal  of  the  matrix  by  switching  the  I's  in  it  to 
O’s  and  the  O’s  to  Ts.  In  other  words,  construct  S  C  N  as  follows: 

z  €  5  if  and  only  if  A'/,_,  =  0  (i.e.,  i  ^  f{i)} 

The  set  S  for  the  matrix  M  in  figure  10  is  {2, 3, 4, 6, 7,  8 _ }.  Since  /  is  one-to-one 

onto  and  S  C  N,  there  must  be  a  number  i  such  that  /(z)  =  S.  There  are  two  cases  to 
consider: 

1.  i  €  f{i).  In  this  case,  A/,.,  =  1.  Hence  i  ^  S.  Since  f{i)  =  S.  we  have  a 
contradiction. 

2.  i  ^  f{i).  In  this  case,  Af._,  —  0.  Hence  i  6  S.  Since  f{i)  —  5,  we  have  a 
contradiction. 

Note  that  this  argument  can  applied  to  a  wide  variety  of  sets  other  than  N.  A  similar 
argument  was  also  used  in  “Russell’s  paradox”  [4]. 


Undecidability  of  the  Halting  Problem 

Cantor’s  simple  cardinality  argument  allows  us  to  prove  the  existence  of  imdecidable 
decision  problems.  Informally,  the  proof  is  as  follows;  there  are  uncouniably  many 
languages  over  {0, 1}*  but  only  countably  many  Turing  Machines.  Thus  there  must  exist 
many  languages  that  are  not  accepted  by  any  Turing  Machine, 

In  this  section,  we  prove  the  undecidability  of  one  such  problem,  known  as  the  Haltimj 
Problem  and  denoted  H  [5].  Informally,  H  is  stated  as  follows:  given  a  Turing  Machine 
specification  i  and  a  string  a',  dues  0,  halt  on  x?  More  formally  //  ts  the  language  defined 
as  follows; 


H  =  {(i,  j)j0,(^)  halts} 

Theorem  4  The  halting  problem  is  undecidable. 

Proof;  Suppose  for  a  contradiction  that  there  is  a  Turing  Machine  specification  h  such 
that  (pk  accepts  (t,x)  if  0,  halts  on  x  and  0/,  rejects  (i,x)  otherwise.  Qh  fan  be  represented 
as  the  following  infinite  two-dimensional  matrix: 

.  f  accepts  if  0,  halts  on  j 
d>h[  .y  j  I  rejects  if  0,  does  not  halt  on  j 

Now  we  will  use  diagonalization  to  derive  a  contradiction.  Consider  the  following 
function  dbl  defined  as  follows: 


dbl(x)  =  (x,x) 


06/ is  a  recursive  function.  Let  h'  =  (QS,  ±,LJ,qo,qa-qr}  represent  the  specification 
of  the  Turing  Machine  dbl*  0/,.  Then  0v  behaves  as  follows: 

, f  accepts  if  0,  halts  on  i 
^  1  rejects  if  0,  does  not  halt  on  i 


Note  that  0/,-  corresponds  to  the  diagonal  of  the  two-dimensional  matrix  representing 
0/,.  We  can  construct  a  Turing  Machine  specification  based  on  the  specification  h'  as 
follows.  Add  a  new  state  and  replace  all  transitions  to  qa  with  transitions  to  q„.  Thus 
0/i-  and  (ph+  behave  identically  except  when  0/,<  enters  qa,  0**  enters  g„.  More  formally, 
we  construct  6^  =  {Q+,r,  i.,S,6'^,(7o,<?a,9r)  as  follows: 

1.  Q'^  —  Q  1)  qn,  where  q„  is  a  new  state  not  in  Q 


2.  S'^iq,a) 


{q',  a',  d)  if  6{q,  a)  -  {q' ,  a',  d),  q'  ^  qa  and  q  #  q„ 
<  {qn,a',d)  if  6(g,  a)  =  0)  and  9  #  (?„ 

(g„,a,/?)  ifq  =  q„ 


It  is  easy  to  verify  the  following  facts: 
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•  /?"  is  the  specification  of  a  Turing  Machine  that  does  not  accept  any  strings.  In 
other  words.  L{0h^)  =  0. 

•  If  Qh'  rejects  string  x.  then  also  rejects  x. 

•  If  Oh‘  accepts  string  x.  then  does  not  halt  on  x.  In  fact  O/,-  enters  state  r/,,  and 

never  leaves  that  state. 

Intuitively  halts  on  x  if  and  only  if  Ox  does  not  halt  on  x.  Let  us  now  consider  what 
happens  when  we  run  with  as  input.  There  are  two  cases  to  consider: 

1.  Oh~  halts  on  h'^ .  In  this  case,  Oh^  does  not  halt  on  h" — a  contradiction. 

2.  Oh-^  does  not  halt  on  h*.  In  this  case,  halts  on  — a  contradiction. 

We  conclude  from  the  above  argument  that  H  is  not  recursive.  □ 

In  other  words,  there  does  not  exist  a  Turing  Machine  that  can  determine  in  a  finite 
amount  of  time  whether  any  given  Turing  Machine  M  halts  on  an  arbitrary  given  input 

X. 

Reducibility:  A  Tool  to  Prove  Undecidability 

In  this  section  we  introduce  reducibility,  a  relation  that  allows  us  to  compare  degrees 
of  difficulty  of  solving  problems.  Using  reducibility,  it  is  possible  to  show  that  many 
problems  are  at  least  as  hard  to  solve  as  the  Halting  Problem.  Since  we  know  that  the 
Halting  Problem  is  undecidable,  it  follows  that  all  these  problems  are  also  undecidable. 
We  now  define  reducibility. 

Definition  21  Let  L\  and  he  any  two  languages  over  some  finite  alphabet  S.  We 
say  that  Li  is  Turing  reducible  to  L2,  written  Li  <t  L2  if  and  only  if  there  is  a  recursive 
function  F  ;  S*  —  S*  that  maps  elements  of  Li  to  elements  of  L2  and  elements  of  Li  to 
elements  of  L2. 

In  other  words,  there  is  a  Turing  Machine  Ai  with  the  following  properties.  If  the  input 
to  M  is  an  element  of  Lj,  M  writes  an  element  of  L2  on  its  tape  before  halting.  If  the 
input  to  M  is  an  element  of  Li,  Ad  writes  an  element  of  Lo  on  its  tape  before  halting. 
Note  that  several  types  of  reducibility  have  been  studied  in  the  literature.  For  this  paper, 
how^ever,  we  will  only  be  concerned  with  Turing  reducibility.  For  the  rest  of  this  paper, 
we  use  the  term  “reducibility”  to  denote  Turing  reducibility.  We  can  prove  the  following 
theorem  about  the  halting  problem  H: 

Theorem  5  For  any  language  C,  if  H  <r  C,  then  C  is  not  recursive. 

Proof:  Suppose  for  a  contradiction  that  C  is  recursive;  there  must  be  a  Turing  Machine 
M  that  halts  on  every  input,  such  that  L(M)  =  C.  Further,  since  H  is  reducible  to  C. 
there  is  a  Turing  Machine  M'  with  the  following  properties.  If  the  i’  put  to  M'  is  an 
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element  of  H,  M'  eventually  writes  an  element  of  C  on  its  tape  and  halts.  If  the  input 
to  M’  is  an  element  of  //,  M'  eventually  writes  an  element  of  C  on  its  tape  and  halts. 

Consider  the  Turing  Machine  =  M'  •M.  We  will  show  that  .VC  halts  on  every 
input  and  L{M'^)  =  H.  Since  the  halting  problem  is  undecidable,  this  immediately  gives 
us  a  contradiction.  There  are  two  cases  to  consider: 

1.  The  input  to  is  an  element  of  H.  In  this  case,  M'  works  as  follows.  First  M' 
runs  until  completion.  Since  the  input  to  M'  is  an  element  of  H .  M'  writes  x.  an 
element  of  C  on  its  tape  and  halts.  .Next  M  runs  until  completion.  Since  x.  the 
input  to  .-VI,  is  an  element  of  £  and  L{M)  =  £,  .VI  accepts.  Thus  M"  accepts. 

2.  The  input  to  M'^  is  an  element  of  H.  In  this  case.  .Vf^  works  as  follows.  First 
M'  runs  until  completion.  Since  the  input  to  M'  is  an  element  of  H .  M'  writes 
X,  an  element  of  £  on  its  tape  and  halts.  .Next  M  runs  until  completion.  Since  x, 
the  input  to  M,  is  an  element  of  £  and  M  halts  on  every  input,  ,Vt  rejects.  Thus 
M""  rejects. 

We  have  shown  that  M'  halts  on  every  input  and  that  L(.M')  =  H ,  giving  the  desired 
contradiction.  □ 

In  section  2  we  will  define  a  problem  P  in  a  finite  economy  and  show  that  the  Halting 
Problem  is  reducible  to  V.  From  Theorem  5,  it  follows  that  V  is  undecidable. 

On  the  Robustness  of  the  Turing  Machine  model 

Even  though  the  Turing  Machine  model  appears  to  be  simple,  it  is  very  powerful.  In 
this  subsection  we  mention  a  few  of  the  enhancements  of  the  Turing  Machine  model  that 
do  not  increase  its  power.  We  hope  that  this  gives  the  reader  some  intuition  for  the 
robustness  of  the  Turing  Machine  model: 

Two-way  infinite  tapes:  The  Turing  Machine  model  presented  in  this  paper  assumes 
that  the  tape  is  infinite  in  only  one  direction.  With  this  enhancement,  we  allow 
the  tape  to  be  infinite  in  both  directions. 

Multiple  tapes:  With  this  enhancement,  the  Turing  Machine  is  allowed  to  have  sev¬ 
eral  tapes,  each  of  which  has  its  own  tape  head.  Each  tape  can  be  controlled 
independently. 

Multiple  tape  heads:  With  this  enhancement,  the  Turing  Machine  is  allowed  to  have 
many  tape  heads  on  each  tape.  This  allows  the  Turing  Machine  to  read  different 
cells  of  the  tape  simultaneously.  Each  tape  head  can  be  controlled  independently. 

Multi-dimensional  tapes:  The  Turing  Machine  model  presented  in  this  paper  assumes 
that  the  tape  is  1-dimensional.  With  this  enhancement,  we  allow  the  tape  to  be 
multi-dimensional  and  infinite  in  all  dimensions. 


By  introducing  non-determinism:  The  Turing  Machine  model  presented  in  this  pa¬ 
per  is  completely  deterministic,  i.e.,  based  on  the  current  state  of  a  Turing  Machine 
and  its  state  transition  function,  it  is  possible  to  determine  the  next  state  of  the 
Turing  Machine.  There  are  several  ways  to  bypass  this  restriction.  One  obvious 
way  is  to  allow  the  Turing  Machine  to  toss  a  coin  at  each  step  and  make  its  tran¬ 
sition  based  on  (1)  its  current  state,  (2)  the  value  in  the  tape  cell  below  its  tape 
head  and  (3)  the  result  of  the  coin  toss.  Other  ways  of  eliminating  determinism 
such  as  non-determinism  and  alternation  have  also  been  considered.  For  a  detailed 
description,  the  reader  is  referred  to  [5]. 

None  of  the  enhancements  mentioned  above  increase  the  power  of  the  Turing  Machine 
model.  Furthermore,  even  if  we  apply  a  combination  of  these  enhancements,  the  com¬ 
puting  power  of  the  Turing  Machine  model  remains  unchanged.  More  precisely,  given 
any  Turing  Machine  M  that  uses  some  or  all  of  the  enhancements  mentioned  above, 
there  exists  a  Turing  Machine  M'  without  any  enhancements  such  that  (a)  M'  accepts 
if  and  only  if  M  accepts,  (b)  M'  rejects  if  and  only  if  M  rejects  and  (c)  M'  neither 
accepts  nor  rejects  if  and  only  if  M  neither  accepts  nor  rejects.  The  proof  of  this  fact  is 
beyond  the  scope  of  this  paper;  for  this,  the  reader  is  referred  to  [5]. 
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